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DETAILED ACTION 

Application Background 

1 . This action is responsive to the amendment filed on 9/26/2007. 

2. No claims have been amended with this response. 

3. Claims 1-6, 9, 11, 12, 14 and 25-30 are pending in the case, claims 1, 6, 9, 12 
and 25 are independent claims. 

4. Acknowledgement is made to the applicant's submission of an Information 
Disclosure Statement, filed on 8/2/2007. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

"(a) A patent may not be obtained though the invention is not identically disclosed 
or described as set forth in section 102 of this title, if the differences between the 
subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was 
made." 

6. Claims 1-6, 9, 12, 25 and 27 remain rejected under 35 U.S.C. 103(a) as being 
unpatentable over Escobar et al. US Patent 5,659,793, filed 12/22/1994, patented 
8/19/1997, (hereinafter "Escobar") in view of Wittenburg et al. US Patent 6,515,656, 
filed 4/30/1 999, patented 2/4/2003, (hereinafter "Wittenburg"). 
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7. Regarding independent claim 1, the applicant defines temporal and nontemporal 
media as "temporal media, such as video, audio and computer-generated animation, 
and nontemporal media, such as still images, text, hypertext documents etc" (page 
4, lines 12-14). Escobar discloses in Figure 1, a graphical user interface for 
authoring presentations, with a temporal media timeline (shown as "Video Time 
Line" at reference signs 140 and 141), nontemporal media timelines (shown as 
"Program Object Time Line" at reference sign 160). Escobar discloses a 
specification for the multimedia presentation. Escobar recites: 'To develop a 
program object, first, a specification (400) for the object is prepared' (column 8, lines 
56-57). 

Escobar discloses a viewer having access to and using the timeline and the 
specification, to displays the media presentation. Escobar recites "Button 174 
permits part or all of an application under development to be run and displayed at a 
location specified, typically in the Display/Edit Window 100, so that the impact of the 
decisions made in editing of a portion or all of an application may be viewed under 
run time conditions" (column 6, lines 41-45). Escobar further recites: "Button 173 
invokes application creation or editing functions which permit objects to be 
assembled into applications with relative timing specified by their placement along 
the timeline tracks" (column 6, lines 37-41). 

Escobar discloses an encoder to output a media presentation from the timeline 
and the specification. Escobar recites: "the objects can be combined and only the 
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combined integrated final application can be sent as a live program" (column 20, 
lines31-33). 

Escobar discloses a graphical user interface for authoring presentations with 
temporal and nontemporal media and their timelines, and a specification for the 
multimedia presentation. Escobar fails to disclose a specification that defines the 
portion of the display area in which of the first and second media tracks will be 
displayed (i.e. the spatial relationship). Wittenburg teaches controlling the spatial 
relationships of the display of the media objects. Wittenburg recites: "The techniques 
described are capable of using a number of different spatial layout techniques and 
transitions for rendering individual multimedia data items to be presented in a 
particular presentation area" (column 14, lines 39-42). Wittenburg further illustrates 
several presentations with spatially related media objects in Figures 6-10. 

Therefore, it would have been obvious, to one of ordinary skill, at the time the 
invention was made, to combine the multimedia authoring tool of Escobar with the 
use of spatial relationships, as taught by Wittenburg, in order to create "a technique 
for viewing and selecting information by incorporating imagery and other media, as 
well as text, that uses a hierarchical organization, and deploys controls for speed 
and direction of information presented' (Wittenburg, column 2, lines 19-23). 

8. Regarding dependent claim 2, Escobar discloses multiple servers managing 
multimedia and data files (together and separately) in Figure 13. Escobar further 
recites "The IDL is stored as an application at 5565 and the process returns to the 
main routine" (column 1, lines 44-45). 
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9. Regarding dependent claim 3, Escobar recites "When an IDL is executed, the DET 
takes the items on the list in order and requests the objects specified by the list item 
by sending a request over the network to the server" (column 20, lines 16-19). 

10. Regarding dependent claim 4, Escobar recites "the server controls a retrieval of 
objects and the assembly of those objects into a program which is then delivered to 
the end user for display at 1 130" (column 20, lines 38-41 ). 

11. Regarding dependent claim 5, Escobar discloses transferring and previewing (see 
above). Escobar discloses previewing prior to transferring in "The module is then 
tested (425) and reviewed by the developer or customer for acceptance (430). Once 
the object is moved to production in the authoring tool (435), installed in the correct 
bin (440) and an appropriate icon attached (445), it is ready for use as desired (450) 
by the non-programmer" (column 8, lines 62-67). 

12. Regarding independent claim 6, Escobar discloses timelines for the temporal and 
nontemporal media, as described above. Escobar discloses a table of contents 
track. Escobar recites: "At least one interactive object track 160 should be included' 
(column 6, lines 26-28). Escobar discloses a table of contents track that includes 
character elements associated with a point in time on the table of contents track. 
Escobar recites: "One timeline is dedicated to interactive objects. Control of 
playback or execution of the objects is achieved using edit decision lists (EDL) and 
interactive decision lists (IDL) which capture the editing decisions made by a user of 
the tool. The interactive decision list is used to activate retrieval of objects from 
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assets stored, to initiate playback of the objects retrieved and to initiate loading and 
execution of program objects all in a sequence corresponding to that represented on 
the timelines" (column 4, lines 17-25). 

Escobar and Wittenburg disclose the control of display spatial relationships of 
media objects, and a display for displaying the media objects based upon the 
timelines and the spatial relationship, as described above. Escobar discloses the 
user selection of a displayed character in the table of contents track that initiates the 
presentation playback to the point in time related to the selected element. Escobar 
recites: " Playback or running of the interactive multimedia application can be 
controlled by executing an IDL at either an end user's location or at a server's 
location" (column 4, lines 27-29). 

13. Regarding independent claim 9, the claim contains substantially the same subject 
matter as claim 1, and remains rejected using the same rationale. 

14. Regarding independent claim 12, the claim contains substantially the same 
subject matter as claim 1, and remains rejected using the same rationale. 

15. Regarding independent claim 25, the claim is directed toward a computer program 
product for the system of claim 1, and remains rejected using the same rationale. 

16. Regarding dependent claim 27, the claim is rejected for fully incorporating the 
deficiencies of the base claim. 
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17. Claims 11, 14, 26 and 28-30 remain rejected under 35 U.S.C. 103(a) as being 
unpatentable over Escobar in view of Wittenburg, and in further view of Gill et al. US 
Patent 6,081,262, filed 12/4/1996, patented 6/27/2000, (hereinafter "G/Vf). 

18. Regarding amended dependent claim 11, Escobar and Wittenburg disclose a 
multimedia authoring system using timelines of temporal and nontemporal media. 
Escobar and Wittenburg fail to disclose the use of a time bar to manipulate the 
media time lines. Gill discloses the use of a time bar in Figure 2, at reference sign 
PL. 

Therefore, it would have been obvious, to one of ordinary skill, at the time the 
invention was made to combine the multimedia authoring system of Escobar and 
Bergman with the controllable time bar of Gill in order "to combine media objects of 
multiple diverse types into an integrated multi-media presentation" (Gill, Column 1, 
lines 8-10). 

19. Regarding dependent claims 14 and 26, the claims contain substantially the same 
subject matter as claim 1 1 , and remain rejected using the same rationale. 

20. Regarding dependent claim 28, Escobar and Wittenburg disclose a multimedia 
authoring system using timelines and spatial relationships of temporal and 
nontemporal media. Escobar and Wittenburg fail to disclose the display area divided 
into frames. Gill teaches the use of display frames. Gill Discloses in Figure 2, a text 
frame (shown at reference sign TB) and a movie frame (shown at reference sign 
MB). 
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Therefore, it would have been obvious, to one of ordinary skill, at the time the 
invention was made to combine the multimedia authoring system of Escobar and 
Bergman with the display frames of Gill in order "to combine media objects of 
multiple diverse types into an integrated multi-media presentation" (Gill, Column 1, 
lines 8-10). 

21. Regarding dependent claims 29 and 30, Escobar, Wittenburg and Gill disclose a 
multimedia authoring system using timelines and spatial relationships of temporal 
and nontemporal media. Escobar and Gill fail to disclose the multimedia 
presentation defined by a markup language document (claim 29) and where the 
markup language document contains additional nontemporal media (claim 30). 
Wittenburg discloses the use of markup language documents with nontemporal 
media. Wittenburg recites: 11 user interface components may include, for example, 
JAVA Script code and data, and dynamic HTML files" (column 4, lines 36-38). 

Therefore, it would have been obvious, to one of ordinary skill, at the time the 
invention was made, to represent the multimedia presentation of Escobar and Gill as 
a markup language document with additional content, as taught by Wittenburg, in 
order to create "a technique for viewing and selecting information by incorporating 
imagery and other media, as well as text, that uses a hierarchical organization, and 
deploys controls for speed and direction of information presented' (Wittenburg, 
column 2, lines 19-23). 
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Response to Arguments 

22. Applicant's arguments filed 9/26/2007 have been fully considered but they are not 
persuasive. 

23. Regarding independent claim 1, applicant argues that a specification, as 
described by Escobar, is: "a specification for the program object, and not for the 
multimedia presentation" (page 7, forth paragraph, of the response dated 
9/26/2007). Applicant is directed to the rejection of claim 1, as described above. 
Escobar discloses a graphical user interface for enabling a user to interactively 
author a presentation, as described above. Escobar discloses the graphical user 
interface having timelines for one or more tracks of temporal media and one or more 
tracks for non-temporal media, as described above. Escobar discloses a 
specification for program objects, as described above. Escobar is specifying the 
program objects, and not the relationship between the program objects. Wittenberg 
teaches specifying relationships between the program objects, as described above. 

24. Also regarding independent claim 1, applicant argues that: "Wittenberg discloses 
no specifying means" (page 8, second paragraph of the reply filed 9/26/2007). 
Applicant is directed to the rejection of claim 1 , as restated above. Escobar discloses 
the use of a specification. Wittenburg teaches the use of the specification to define 
spatial relationships between multimedia objects on a display. Wittenburg recites: 
" The techniques described are capable of using a number of different spatial layout 
techniques and transitions for rendering individual multimedia data items to be 
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presented in a particular presentation area" (column 14, lines 39-42). Wittenburg 
shows in Figure 6 at reference sign 64, a plurality of multimedia objects with a 
spatial relationship. 

25. Regarding Independent claim 6, applicant argues Escobar fails to disclose the 
table of contents track claimed (bottom of page 9 to the bottom of page 10, of the 
response filed 9/26/2007). Escobar discloses an interactive decision list (IDL) as 
described above. Escobar defines the IDL as: "77?e interactive decision list is used to 
activate retrieval of objects from assets stored, to initiate playback of the objects 
retrieved and to initiate loading and execution of program objects all in a sequence 
corresponding to that represented on the timelines" (column 4, lines 21-25). A list is 
composed of words that are composed of one or more characters. The user can 
select an element of the IDL to initiate playback of the specific object related to the 
list item. 

Conclusion 

26. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory action 
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is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be calculated from 
the mailing date of the advisory action. In no event, however, will the statutory 
period for reply expire later than SIX MONTHS from the mailing date of this final 
action. 

27. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gregory J. Vaughn whose telephone number is (571) 
272-4131. The examiner can normally be reached Monday to Friday from 8:00 am to 
5:00 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen S. Hong can be reached at (571) 272-4124. The fax phone 
number for the organization where this application or proceeding is assigned is (571) 
272-2100. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR 
only. For more information about the PAIR system, see http://pair-direct.uspto.gov. 
Should you have questions on access to the Private PAIR system; contact the 
Electronic Business Center (EBC) at 866-217-9197 (toll-free). 




Gregory J. Vaughn STEPHEN HONG 

Patent Examiner Supervisory patent examiner 

November 21 , 2007 



